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ABSTRACT 


A closed- loop compensatory tracking task has been developed which 
yields a measure of the human operator's time delay characteristics 
while tracking, constrains his behavior to within very narrow limits, 
and provides a low- variability indicator of the operator's tracking 


i _• j 
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The task xs called the Crxtxcal Task because the operator 


is required to stabilize an increasingly unstable controlled element 
up to the critical point of loss of control. 


In the present report, a first-order divergence is used as the 
controlled element to obtain certain theoretical advantages. Based on 
recent human response research, a theoretical analysis of this man-machine 
system is performed, and an experimental program is described which enables 
describing function and critical task measures to be compared. A specific 
critical task mechanization and operating procedure is developed which 
yields consistent and reliable measurements of the critical levels of 
instability. 


An analysis of the describing function results shows that, when 
operating near criticality, the subject's behavior is adequately repre- 
sented by recently developed human operator describing function models 
and adaptation laws. Further, the extrapolation of describing function 
data to the critical level of instability shows that the operator con- 
sistently loses control at small, but finite, mean stability margins. 
The just -controllable first-order divergence is shown to be related 
dominantly to the operator's effective time delay, and secondarily to 
the nominal variations of his average tracking characteristics euad to 
mid- frequency phase lags due to long period kinesthetic adaptation 
effects. 
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A "CRITICAL" TRACKER* TASK POT MAB-MACHIHB RESEARCH 
TTHT^wm to THE OPERATOR'S EFFECTIVE DELAY TIME 

Bart I. Theory and. Experiment b with 
a First-Order Divergent Controlled. Ele m e nt 


SECTICH I 
zantaDOOEZGH 

Recent research in man-machine systems (refs. 1—5) shows that 
several important system characteristics (such as closed-loop stability, 
bandwidth, etc.) are critically dependent on the value of the pilot's 
effective delay time, t 0 . Effective delay time is defined herein as an 
apparent "pure time delay," "dead time," or "transmission lag" which is, 
in actuality, a low frequency approximation to the sum of several high 
frequency effects. The primary constituents of x e are neural transmis- 
sion delays, effective lags due to neural coding, any delay time involved 
in the human pilot's equalization activities, and an effective delay 
approximating the higher order terms in the neuromuscular response of a 
particular limb. (An additional component in T e results when the system 
is such that the equalization lead, T^, can be used for partial compensa- 
tion of high frequency lags.) While some components of T e are involved 
in the classical step reaction-time delay, others, such as the cerebral 
equalizing and processing delays, are different. Furthermore, during 
continuous tracking of randomlike inputs, inodes of human subsystem opera- 
tion different from those used for discrete movements are brought into play. 
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e.g., contrast the saccadic (jump) movements of the eyeball versus its 
smooth pursuit movements for respective step or smooth changes in the 
desired point of regard (ref. 6). Consequently, a simple psychomotor 
test for measuring the effective delay time during continuous tracking 
would be of great practical value. 

Such a tracking test, for use in programs related to man-machine 
integration and piloted vehicles should have the following attributes : 

1 . Provide a clear measure of tracking behavior which 
is related to other tracking tasks and to the 
subject's psychomotor capabilities. 

2. Be sensitive enough to reveal significant changes 
in psychomotor performance due to the applied 
experimental variables or stress conditions. 

3* Can be validated rapidly to achieve a high level 
of confidence, meaningfulness, and baseline data. 

4. Be usable under a wide variety of test conditions. 

This report summarizes exploratory research on a critical task 
technique (involving compensatory tracking of a certain type of con- 
trolled element) in which a single experimentally varied parameter will 
reveal the pilot's effective delay time during tracking tasks essentially 
free from experimental artifacts. In applying servomechanism techniques 
to the analysis of pilot— vehicle systems we have discovered that, by 
proper choice of a first- or second-order divergent "controlled element," 
the pilot ' s tracking behavior can be artificially constrained to simple 
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i forms, in which r e is the dominant parameter and is measured by the 
critical divergence time constant, beyond which closed-loop control 
becomes impossible. 

The theoretical basis for the concept resulted from aircraft handling 
qualities investigations in references 7 and 8. The use of a constraining 
aircraft stabilization task was originally proposed as a critical task by 
Ashkenas in an unpublished memorandum (ref. 9) , and verification of the 
theoretical predictions was published in reference 10. A simplification 
of the task from the complex dynamics of an aircraft to a simple first- 
order controlled element was proposed by Durand in 1 961 and was verified 
as an unpublished byproduct of the work reported in reference 10. The 
large scale investigations of reference 2 included two simpler unstable 
controlled elements to determine the human operator's describing function 
under subcritical operation, and these results indicated that the under- 
lying assumptions would probably be met near critical conditions. 

The present program was started to develop the critical task concept 
into a usable psychomotor test. This includes laying a firm analytic 
foundation for its justification, developing a specific test configura- 
tion, and verifying the indicated measurements by independent measure- 
ments of an operator's describing function under conditions closer to 
criticality than reported in reference 2. 

Hie report starts with a description of the human response parameters 
affecting effective delay time, leading to the critical task concept and 
its theoretical basis, all drawing heavily on the background of reference 2. 
There follows the evolution of a specific critical task configuration and 
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procedure, including some early results. Next comes the experimental 
validation of the test, which was performed in the Human Response Facility 
at The Franklin Institute Laboratory for Research and Development. Finally, 
the implications and conclusions of this phase of the program are summa- 
rized. Certain mathematical analyses and data are contained in the Appendix. 
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SEcnon n 
TEECKT 

A. THE HUMAN QPEBATCG MODEL 

In this section the current mathematical model of the h uman operator 
will be summarized to form a basis for subsequent theoretical analyses 
of the critical task. The emphasis will be on those features affecting 
the operator's apparent delay time. 

The critical task is a single-loop compensatory tracking task, for 
which the important parameters are defined in figure 1 . Two key features 
are the solitary operator stimulus (the error) and the random-appearing 
nature of the forcing function (the system input). Numerous experiments 
(e.g., those summarized in refs. 1 and 2) serve as the data base for the 
analytical model describing human operation and adaptation for compensa- 
tory tracking with a visually presented, random-appearing forcing function. 

The model of figure 1 comprises three elements: 

1 . A general quasi-linear describing function form. 

2. A series of "adjustment rules" which specify how to 
"set" the parameters in the generalized describing 
function so that it becomes an approximate model of 
human behavior for the particular situation of 
interest. 

3. A set of remnant power spectra related to the 
parameters in Item 2. 
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The most precise form of operator describing function* for compensatory * 
control tasks is (see ref. 2 for details): 


Y p (j<o,t) 



Gain 


Time 

Delays 


Neuromuscular 

system 


Equaliza- 

tion 


0 ) 


A slightly modified form of this equation is used to facilitate comparison 
between the operator gain in this and various simpler or earlier models. 
This form is: 


i K/ j +d«rW] 




'(TlJ<d+i) 


* 2 £ N j“ 

+ — - — + 1 

“N 


(Tjjtu+l) 


( 2 ) 


where K rt = Kp(Tp[/T^) = "mid-band pilot gain" 


The operator is able to adjust his mid-band gain, K^, and equaliza- 
tion parameters, Tp and Tj, within a fairly wide range for suitable 
loop closures. These adjustments have been firmly validated by experi- 
ment and their application is treated in numerous other references 
(e.g., 2 — 5 and 7 — 10) and need not be further discussed at this point. 
The term K(afp/crji) in the describing function refers to the indifference 
threshold describing function. This is nearly unity for difficult 
tracking tasks, because the serial thresholds are consciously reduced 

*Because this describing function is strictly valid only in the 
frequency domain, it is herein represented as a function of the frequency 
operator (jo>) instead of the Laplace operator (s) . 
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to their nominal levels, while the rms inputs to the thresholds (the 
displayed error, etc.) are relatively large. 

Next, consider the time delay terms. The pure time delay represented 
hy the e term is due to sensory excitation (the retina in the visual 

case), nerve conduction transport lags, computational lags, and other 
latencies in the central nervous system, can also include sampling lags 
associated with multiple display scanning. It appears to he essentially 
invariant with forcing function and controlled element dynamics for random- 
appearing input tasks. However hoth intersubject and intrasubject 
variations occur . Empirically the minimum value fbr seems to lie in the 
range from about 0.06 to 0.10 sec for single-loop tracking situations. 

The operator's time delay variation, T r (t), is not thoroughly under- 
stood at this time, but is believed to be a good way to describe one 
source of remnant. In that case, it would be a function of attention level, 
task difficulty, etc. Any variation in T r results in an apparent phase lag 
fluctuation and sets one fundamental limit on the minimum phase margin 
required for closed-loop stability during a long duration tracking task. 

Over long tracking runs (1—5 minutes) the mean value of T r (t) is zero, but 
over very short periods (on the order of a few seconds) it may drift seme what . 
This point will be discussed later in interpreting the experimental results. 

The neuromuscular (NM) system is represented here by a formidable array 
of parameters. A detailed description is beyond the scope of this report, 
but is currently in preparation. The pair of terms (jo> + l/T K )/(jo>+ 1 /T£) 
is a tentative model of the effects of kinesthetic sensory adaptation (or 
"washout") in the neuromuscular subsystem. Tpr is the time constant of 
sensory adaptation, on the order of tens of seconds, and is analogous to the 
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time it takes for the feel of newly put-on clothing to disappear. 

T^- is associated with a closed-loop root resulting from T^ and is usually 
much longer than T&. Consequently, 1 /Tk and 1 /t^ constitute a very low 
frequency lag-lead pair in the frequency domain. They are usually below 
the bandwidth of measurement, leaving only a small residual amplitude 
rise but appreciable phase lag at the lower input frequencies. An impor- 
tant observation about kinesthetic adaptation is that the low-frequency 
phase lag increases under difficult tasks, where concentration and 
neuromuscular system tension are maximum (ref. 2). 

The remaining third-order characteristics of the KM portion of 
equation (l ) are associated with a high frequency first-order lag, Tn-| , 
and an underdamped second-order lag, cj^j, £jj. The Tjj^ term is related to 
the viscous damping terms in the closed inner KM loops, while the second- 
order terms reflect the combined stiffness, inertia, and damping in the 
arm-plus-stick system. Direct measurements of the second-order charac- 
teristics were made in reference 12, where, during a continuous tracking 
task, the complete arm-plus -manipulator was struck and the and 
were inferred from the resulting transient response. Generally speaking, 
most of these dynamics occur at or beyond the frequency of followable 
inputs (about 10 rad/sec). Thus they can be represented via simpler 
terms by combining the main effects of the third-order model (a phase lag) 
into a single first-order KM lag term (Tjjjcu + 1 ) 1 , where 

^ + (^f) <5) 

or even to merely include Tjj as an additional time delay to be added to t^. 
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One frequently used term should be clarified at this point. 

"Unity-gain crossover frequency" or just crossover frequency , cq., is 
defined as that frequency where the open-loop amplitude ratio (output/error) 
equals 1 .0. The crossover frequency is important because it approximates 
the closed- loop bandwidth of the compensatory tracking loop, because it 
defines the frequency region where most of the dynamic interactions of 
feedback occur, and because it provides the dividing criteria between 
relatively high (> oq.) or low (< oq.) frequencies. As reference 13 clearly 
demonstrates, it is only near crossover frequencies that accurate pilot 
describing functions are required, and it is in the crossover region that 
the effective delay time is defined. 

b. mrsasm war xna 

Consider a sine wave of a given frequency, cs, operated on by a 
time delay, t. A fixed value of t will not alter the amplitude of 
the output, but will shift its angular phasing with respect to the 
by an amount. Zip, which increases with the applied frequency: 

Zip = — TCD 

where Zip is in radians (negative 
for lag) and to is in radians/second 

In reverse, considering a frequency response plot, a phase lag which 
varies as a linear increase with frequency (and with unity amplitude 
ratio) represents an effective time delay. 


pure 

input 
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The definition of the operator’s "effective delay time" while 
tracking a continuous random input is related to the mid-hand lags 
in the complete describing function (eq. 1 ) . The breakpoints occurring 
at frequencies greater than the crossover frequency are ojj and 1 /T^ , 
and 1 /t^ will lie in this same frequency region if low frequency lead 
equalization is not required in the system. The phase lag corresponding 
to these high frequency components is: 


Zkf> hi = -cufx^ + T r (t)] - tan 1 %.ja> — tan 1 




+ tan 1 Tlcd (5) 


- (-V 

w 


At frequencies in the mid-band region (near cd c ) , this becomes: 


*Phi = - 


t \ 

T d + T r (t) + % 1 + — - T L 


0 ) 


whence the effective delay time is defined as: 


T e = T d + T r( t ) + %•] + Tl 


(6) 


The effective time delay, x e , is the sum of the "near crossover" lead 
and lag time constants plus the basic transport delays. 

Changes in x e imply changes in one or more of its constituents. It is 
from this consideration that measures of T e have promise as integrated 
indicators of the pilot's physiological integrity in a tracking task. 

The adequacy of any such differential measure (i.e., x eactual - x 6nnTri ■ nQ -, ) 
is thereby dependent on the stationarity of x e in the normal organism. 
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T e appears to be stable (with small variance) over a small number of 
trials , yet exhibits learning effects via slight reductions over a large 
number of trials. It appears to be critically dependent on those physio- 
locigal and psychological factors involved in the attainment of high grade 
skill. It offers potential as a general measure of psychomotor perform- 
ance when only a few runs are taken, while terminal values after many 
runs indicate maximal tracking performance. Further, since current values 
can be conpared with either absolute minima, previously obtained or average 
population values, the measure provides some indication of probable 
proficiency on difficult tracking tasks. 

C. THE CRITICAL TASK CO N C E PT 

The measurement of r e while tracking is normally a very difficult 
procedure, in which one of two main approaches can be used: 

1 . The pilot's quasi- random input describing function 
is first obtained, using Fourier analysis or a 
cross -spectral analyzer. Then the frequency 
response amplitude and phase are simultaneously 
curve-fitted to remove the linear response terms. 

From the residual phase versus frequency, the T e 
is found using the following relationship: 

_ d(cp residual) /~\ 

T e ~ do> 

2. A parameter tracker, or "mimic, " is operated in 
parallel with the pilot, and contains an approxi- 
mation to a pure time delay (possibly a first- or 
second-order Pade polynomial). This delay, as well 
as other parameters, is adjusted to minimize the 
difference between the pilot and mimic outputs, and 
the "best fit" value taken as r e . 
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It should not be surprising that very few accurate data on T e 
exist; such sophisticated measuring and data analysis procedures 
preclude any large scale sampling T e by these methods. 

The critical task technique can be explained as follows, using 
a simplified pilot describing function. The complete model alters 
the details but not the main essentials . Consider a compensatory 
closed-loop tracking task with a low frequency randomlike input, and 
a controlled element having a variable first-order divergence (fig. 2), 
Y c = -Kc/(-Ts + 1). The appropriate pilot describing function for this 
controlled element (ref. 2) is a pure gain, Kp, and an effective delay 
time, T e< The latter is approximated by a first-order Pade polynomial, 
giving for Y p : 


Y 


P 


K p e 


T e<3 cu 


K r 


(jf + 1 ) 

(ir + ^ 


( 8 ) 


The system surve/' of figure 2 shows that there is a minimum gain, Kj^, 
which must be reached to stabilize the system (at ( 7 )) , and a maximum 
gain, Km»y , at which it again goes unstable (at (5)). At Kopt (near(2)) 
the system is stable, but only marginally so. If -T is now decreased 
(more unstable) , then it can be seen that both the phase margins and 
gain margins vanish as T approaches T e . Furthermore, the pilot cannot 
help his control by adopting low frequency lead or lag equalization; 
lead gives less gain spread and lower gain margins, while lag gives more 
phase lag and thus reduces the phase margin. Consequently, the pilot is 
constrained to adopt a nearly pure gain response in the crossover region , 
and in the ideal limit Tm-r n = r e . Further systems analyses and data for 
first- and second-order divergent controlled elements of this type, using 
human pilot models, are given in reference 2. 

*A "system survey" is a systems analysis, considering both the perform- 
ance and stability aspects of a loop closure, using simultaneously the 
root locus, conventional jcn-Bode, and "Siggy" Bode techniques included in 
the Unified Servo Analysis Method of reference l4. 
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As an alternative to the graphical solution, consider the analytical 
solution, which is particularly simple in this case. With Yp in terms 
of s for analytical purposes, the open -loop transfer function is: 


%<*) - V S > Y =< S > - - k (3STTT 

■ 7 \f s — 7 * K ■ V. w 

(-Tb + lll-f B + II 

After some algebra, and using the basic closed-loop relationship that 
Y cl (s) = X 0L (s)/[l + Y ol (s)] , the closed-loop transfer function is: 


-K (- ^ s + l) 


Xcl( s ) 



( 10 ) 


Note that in this simplified case 0 ax the critical condition 

(point (T) , dashed root locus in fig. 2). Then, from the term in 
equation (10), the result is K -| j ^ t. =1-0. Putting this in the total 
damping term, = 0, gives: 

^ - Y - ‘-V 21 - 0 at ^critical s T <= 

Therefore : T c = T e 

With the more complete neuromuscular system and finite stability margin 
effects included, the numerical results are modified, as will be shown later. 
Still preserved, however, are the essential constraining effects on the 
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pilot's behavior (to pure gain near the shaded phase region of fig. 2) 
and the close correspondence between T g and T g . 

The critical task concept is, then, to provide a divergent controlled 
e lem e n t of a form that tightly constrains the allowable pilot equalization 
near the region of crossover, leaving the effective delay time, t 6 , as the 
sole determinant of system stability. The divergence is then slowly 
increased until control is lost, whereupon the critical divergence time 
constant, T c , is a measure of T e . 

D. effects of operator model refinement 

Stability .— The definitive results on pilot describing functions in 
reference 2 demonstrate that the precision pilot model [represented by 
eq. 0)] represents the measured operator describing function data 
with remarkable accuracy over a two-decade range of frequency. 
Unfortunately, a ten parameter model is too cumbersome for routine 
data analysis, and it is not really necessary to represent every detail 
of the data to get a good understanding or measurement of x e , as the 
subsequent analyses will prove. We will now make three loop closures 
around a near-critical controlled element, using successively simpler 
pilot models: first, the complete "precision" model; second, an 

"extended crossover" model; and, third, the "simple crossover" model 
(all are derived and explained in detail in reference 2) . The small 
errors in the closed-loop roots, stability margins, and error spectra 
resulting from the simplifications will then become apparent. The objec- 
tive is to justify the use of these more tractable models for the 
subsequent analytical investigations. 





The controlled element to be examined is: 


Y c 


m(s) _ 4 

c(s) ~ s — 4 


OD 


which is near the observed limit for continuous tracking of a rela- 
tively wide band input, having a bandwidth of = 4.0 rad/see. 


The precision model parameters, actually based on mea sured describing 
function data to be shown later in figure 1 7, are as follows : 


K* 

= 

1 . 9 cm/cm 

td 

= 

O.O65 sec 


= 

0.02 sec 

Ti 

= 

0 

% 

= 

2.5 sec 

Tk 

= 

25 sec 


= 

O.O625 sec 

“ft 

= 

23 rad/sec 


= 

0.1 



= 50 sec ^ 

i/Tk 

= 0 . 4 o sec 1 

T/Tr 

—1 

= 0.04 sec 


= 16.O sec 


The complete precision describing function for this case is thus: 


l Pp 


c(ja>) 

e(jcu) 


1 . 


Se-- 065 -’® (j. + + l) 




02 ) 


JCD + 1 


The extended crossover model of reference 2 is a much simpler form 
of equation (l ) , reasonably accurate over a range of frequencies of more 
than one decade spanning the crossover region, in which the high frequency 
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neuromuscular dynamics are represented only by their phase lag, i.e., as 
increments of effective delay time, while the low frequency kinesthetic 
lags are represented by a single inverse delay time, a. Thus, 


Yp xc 


-j[(a/<n) + T e u>] 


(?I> + 1) 

(Txjod + 1 ) 


( 13 ) 


where a = l/Tj £ — i/t^ 0*0 

T e = T d + + 2 ^n/% (15) 

T L , Tj as in equation (l) 

Kp here corresponds to the mid-frequency gain, K n 


Often, when Tt is small and 1 /Tp, is beyond the crossover region, 
as here, it is also included in t q . With these simplifications the 
previous parameters for eq. 12 yield, for the extended crossover model: 


Yp XC 


1 g e -j[( - 36/ro) + - 1 1 6 co] 


(16) 


This is the form which has been found best suited for fitting of first- 
order critical task data. 


The simple crossover model merely ignores the low frequency kinesthetic 
lags and thus is represented, in general, by: 



e - ’ T e < i cn 


(T L jao + 1 ) 

(Tjjoi + 1 ) 


(IT) 


For the specific numbers here, and noting that Tj = 0 and including -the 
small value of Tl in t e : 



1 -9e ‘ 


1 1 6jo) 


(18) 
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* This is the simplest model capable of demonstrating the significant 
aspects of critical tasks, and lends itself to analytic manipulation 
more readily than the extended crossover model.* 

The comparative loop closures can now be made. Root-locus and Bode 
plots for each case are compared in figure 3* where the closed- loop 
roots corresponding to or Kp = 1 -9 are designated by the □. (Here, 

exact expressions for the phase lags from t*. and a were used.) Figure 3 
and Table I demonstrate the following points: 

1 . The dominant closed-loop imaginary roots near 
qjj, = 8 rad/sec sire closely given by all three 
pilot models. 

2. The dominant closed- loop frequency is near the 
unity-gain crossover frequency shown on the Bode 
plots; o£ L = a*.. 

3* The simple model, having the least phase lag near 
crossover, results in the highest damping ratio 
of the dominant roots, and highest phase margin. 

The main effect of the more precise models is to 
make the minimum unstable frequency rise from zero 
(as on previous fig. 2) to the crossover region. 

The precise low and high frequency instability 
points, o^i and cuu. 2 > are closely approximated by 
the extended crossover model. 

5* The damping of the second- order neuromuscular 
dynamics is increased when the loop is closed. 


*One additional approximation made in most analyses is to represent 
the time delay terms by their first- or second-order Pade approximations. 
Thus: 


e -r e jcu ^ 



cu « — 
T e 


e -tcc/jcD 4 



cd » a. 


(19) 


( 20 ) 
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6 , It- can "be inferred "by inspection of figure 3, 
and demonstrated by computation, that the 
optimum crossover frequency, <x> c , (with respect 
to stability and performance) drops only slightly 
as 1 /T is increased (more instability) , and ends 
up near the crest of the phase curve hump when the 
stability margins vanish. For the simple model, 
follows the precise value at first, then continues 
to suddenly decrease toward zero as 1 /T approaches 
the critical value. Nevertheless, down to the very 
low stability margins shown here, the simple model 
gives correct trends in most of the closed-loop 
parameters . 

This numerical example demonstrates that the extended crossover model 
gives a remarkably accurate approximation to the precision model, and 
even the simple model shows the correct trends in the closed-loop 
stability characteristics . 


TABLE I 

SUMMARY OF LOOP CLOSURE RESULTS 


MCCEL 

PRECISION 

EXTENDED 

CROSSOVER 

SIMPLE 

CROSSOVER 

Dominant Root: 




ucl (rad/sec) 

7-7 

7.4 

7.9 

£cl 

0.31 

0.32 

O.36 

Crossover Region: 




(jq. (rad/sec) 

6.5 

6.7 

6.7 

(rad/sec) 

1 -7 

1 .8 

0 

(rad/sec) 

1 1 .0 

1 1 .a 

1 1 .4 

Phase margin (deg) 

Gain margins (dB) ^1 .. 

at (Dug 

13 

5 

3 

l4 

5 

4 

17 

6 

4 
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Performance As a performance consideration , the closed- loop error/input 
response will now be compared for each model. The error/input response is 
given by: 

Gie(<jCu) = ifij = 1 + Y 0L (jco) 


The Fade approximations of equations (19j and (20) were used to approximate 
the delay terms, and the resulting closed-loop factored transfer functions in 
terms of the Laplace variable, s, are: 


With Precision Model 


(s+ .04)( 

s- 4) (s + 1 6 ) (s + 31 ) 

|s 2 + ; 

2(.1)(23)b+ (23) 2 ] 


(s+ . 90 ) (s + 32 . If) 

s 2 + 2(.3l)(7.7)e+(7.7) 2 ] 

[ s 2 + 2(.23)(20.7 )s + (20. 7) 2 ] 


( 21 ) 

With Extended Crossover Model 


Gieyc( s ) 


(s - . 1 8 ) (s - 1 +)(s + 17 - 2 ) 

(s + .65) [s 2 + 2(.32)(7^)s + ( 7 ^) 2 ] 


With Simple Model 

Gieg( s ) = 


(s ~ 4)(s + 17 - 2 ) 

[s 2 + 2(.56)(7-9)s + (7-9) 2 ] 


( 22 ) 


(23) 


The power spectral density, or simply "error spectrum" of the error 
for a specified input, is obtained by multiplying | G^ e | 2 by the input 
spectrum. The mean square error relative to the mean square input is 
given by the integral over the input bandwidth of this spectral density, 
as follows: 

$ ee (a>) = S> i;L (a>) I G ie ( Jcd) | 
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J c ®ee(®) dto 

f°° 

J q ® 1± (m)d0) 


( 24 ) 


For a rectangular input spectrum of bandwidth o^, 

— o>l 

-=• - q- jf |0 ie (j»)| 2 to (25) 

Rather than assume an input spectrum at this point, just the square 
2 

modulus | G- e | is plotted, in figure 4, for each case. Also noted in 
the figure are the bandwidths corresponding to tq = 1 .5 and 4.0 rad/sec. 
This comparison shows that: 


1 . The error spectra for the three radically different 
appearing models are quite similar, especially in 
the range of frequencies below 4 rad/sec where 
most inputs are concentrated. 

2. For inputs cut off at moderate frequencies like 

= 1*5 to 4.0 rad/sec, the main difference is 
slightly less error at the low end of the spectrum 
for the more precise models. 

3. The large peaks are sensitive to the slight changes 
in closed-loop damping ratio of the dominant root 
at <*££/ Consequently, the higher frequency compo- 
nents of the error will be more sensitive to the 
model used than the low frequency portions of the 
error. 

4. The dip in the precision case near 23 rad/sec is due to 
the neuromuscular system dynamics, ojj and 

Generalizing these and similar results, we conclude that, compared 
with the precision pilot model, the more analytically tractable extended 
crossover pLlot model will reveal most of the significant theoretical 
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implications of critical tasks. Even the very approximate simple pilot 
model will reveal the main trends of such loop closures down to the 
point of very small stability margins. 

E. SOME THEORETICAL IMPLICATIONS 

Simple model .— The reason for seeking simpler theoretical pilot 
describing function forms t han the precision model is to permit parametric 
analyses of the stability and performance in the critical task. In the 
previous section the simple pilot model for the first-order critical task 
has been shown to yield reasonably accurate trends in the mid- frequency 
dynamics, the stability margins, and the error spectrum. Let us now look 
at some of the theoretical implications which can be drawn by using the 
simplest operator model. 

First, consider the behavior- constraining effects of the critical 
task as the divergent root is made more unstable.* As mentioned 
previously, a first-order divergent controlled element is such that 
no pilot equalization is required in the crossover region. Low frequency 
lead equalization would increase the phase margin, but only at the expense 
of gain margin, and conversely for lag equalization. The final test of 
this theoretical result (that no equalization is required in the cross- 
over region) will have to rest on experiment. 

The narrowing range of gain and phase margins as X is increased 
toward criticality (incipient loss of control) can be easily shown 
analytically using the simple crossover model. 

*For convenience the inverse time constant will henceforth be given 
a single symbol, X = 1 ft. 
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Study of figures 2 and 5 would be helpful before starting this 
discussion. From the denominator of equation (l 0) , the open-loop 
static gains necessary for the system to be unstable, > 0 and 

5 C1 > 0, are: 


■Wn ' 1 

2T 

W = r- 

e 



(26) 


Gain margin is defined as the ratio (expressed in d£) of a 
specified gain to the gain for neutral stability. For the situation 
here, there are two gains for neutral stability; hence the optimum 
closure gain to maximize both gain margins is that gain which lies 
in the middle of K moy and K m j_ n expressed in IB. In other words, 
the gain for maximum gain margins, is the geometric mean of 

Kmin an< ^ ^max ’ Thus, 


Kgm 


- V^min K max - (t 6 X "*) 


1 /2 


(27) 


The maximum phase margin and the corresponding gain can also 
Using the actual delay time in equation (9), the phase angle 
given by: 

cp = -n - T e O) + tan Too 


be computed, 
in radians is 

(28) 


Thus, the phase margin is: 


% 


it + cp 


— t <x> + tan 
e 


Tm 


(29) 
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At the maxi mum phase margin point, the slope with respect to frequency 
is zero: 

T 

— — = 0 = 5 - T e 

ocd 1 + ( Tto )^ 

Solving this for the frequency for maximum phase margin, o^: 

= Y Vl~ ' 1 J T e ( 5 °) 

This value of may he put back in equation (29) to compute cp^, and 
can be used to compute or to locate it graphically. Remember that 
the simple model represented by equation (30) is not completely accurate 
in the limit as T/r e — 1 , where the above equation indicates that — ► 0 , 

whereas in the more precise models cupj^ remains at a finite frequency. 

To illustrate the constraints on these parameters, figures 5 and 6 
show some results from the more extensive computations in reference 15. 

In figure 5 are plotted the gains for the various stability margins as 
the open-loop instability, X, is made more unstable, with the effective 
time delay held constant at a typical value of T e = 0.2 sec. There is 
a very rapid decrease in all the stability margins as the critical con- 
dition is approached. More specifically: 

1 . The gain for max tn nun gain margins is between 

the gain for maximum phase margin and the gain for 
minimum rms error. The maximum gain margins, Kj^, 
are marked along the Kqj^ curve. 
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2 . 


Kpm : The gain for maximum phase margin is on the 

low side of Kq^, but is very similar. The maximum 
achievable phase margins marked along this curve 
become quite low (< 20 deg) well before the critical 
point is approached. 


3- 


4. 


K^q Q : The gain for a practical minim-urn phase margin 

of 1 0 deg is near the stable gain limit at noncritical 
conditions, but departs appreciably from it for 1 > 3 
(in general, for Xt s > 0.6) . 


Sain for minimum rms error with a 
rectangular-plus -shelf spectrum of the b 6 type 


(ref. 16 ) and = 2.5 rad/sec is very near the 
maximum stable gain. Because this criterion 
corresponds to a phase margin less than 1 0 deg 
and gain margin less than a few dB, it is doubtful 
that the theoretical minimum error will be approached 
under most near-critical conditions. This analysis 
ignores the effect of remnant, which will generally 
increase the total errors and reduce K emin • 


Except for the Ke^ curve (which depends on a given co^ and input spectrum 
shape), the stability margin curves can be normalized to any x e in terms 
of the ratio of T to T e (or its inverse, t 6 /t = \T e ) as shown at the top 
of figure 5 • 

Next, consider the theoretical error performance implications of the 
simple model, as shown in figure 6. Here, the normalized error,* 
e rmsArms> i s shown versus the instability, X, for gain adjusted to 

*The normalized error is computed with standard procedures as outlined 
near equations (24) and ( 25 ) herein and in references 2 and 15* 
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(maximum gain margin) . Two key conclusions may be drawn from the error 
analysis represented by figure 6: 


1 . The tracking error rises very steeply as the 
instability is increased beyond approximately 
two-thirds of the ideal critical value. 


2. The rms tracking error exceeds the rms input 
by a factor of 5 to 10 as criticality is 
approached. 

The practical implications of these last two theoretical findings 
are very important. First, they imply that, in order for the displayed 
error to remain within bounds, the input level must be very small compared 
to the display range. (There will be further discussion of this point 
in the section on "Critical Task Development . ") Second, it must be 
remembered that the pilot remnant will induce further errors, which will 
be similarly magnified during closed-loop operation. This compounds the 
display problem. These predictions, made well before the experiments to 
be described in later chapters, were verified in practice. 

Extended crossover model .- The residual mid-frequency effects of the 
low frequency phase lags from the Tg, T^ effects detract from the phase 
margin which would be computed from the simple model alone (see fig. 3) , 
and reduces the ideal X at which all stability margins disappear. This 
theoretical limit is rederived in Appendix A using the extended crossover 
model, or "a-model," of the operator. The result is: 


Xg id eal 
1 / T e 


a « T e a£ 


(3D 
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For a typical value of ax e = 0.04 it can be seen that the zero margin 
limit is reduced to X A 0.8/r e compared with 1 = 1 .0/f e for the simple 
case. The exact proportionality between the limiting X and 1 /t 6 in the 
simple model case is also modified by the a term, but this is a second- 
order effect for reasonable values of the parameters. However, the 
refined limiting case may not be of too much importance if finite 
stability margins are required for control, since the simple model 
results have been shown to be valid under these conditions. 

F. SUMMARY CF THEORETICAL PREDICTIONS 

At this point we will recapitulate the particular theoretical assump- 
tions and predictions which are to be validated by the subsequent experi- 
ments. It is assumed that the basic assumptions applying to continuous 
compensatory tracking by a human operator are met (e.g., random-appearing 
input, well-trained operator, proper display and control gains, etc.). 

The main special assumption of this theory is: While tracking with 

a simple first-order divergent controlled element having a slowly adjusted 
divergent root, the operator's behavior remains quasi-stationary and can 
be represented by the same describing function forms as proven valid for 
constant-X conditions. 

From these basic (and one special) assumptions, the analysis of 
operator behavior has led to the following derived predictions, which 
are to be tested experimentally: 

1 • Low run-to-run variance in all measured parameters 
is expected because of the constraining nature of 
the first-order critical tasks. 

2. As the instability X approaches its critical value, 
the tracking errors will drastically increase and 
the stability margins will decrease . 
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3> The neuromusc ular system will he forced to its 
"tightest" mode of operation, to achieve minimum 
neuromuscular contribution to T e at high frequencies, 
with an increase in a at low frequencies (from ref. 2) . 

4. The magnitude of Y p should be nearly constant, i.e., 
a "pure gain" over the stable range of crossover 
frequencies, i.e., over roughly a decade from c%i 

to cu^ • 

5 . The limiting level of X which can be tracked for more 
than a few seconds will be less than the theoretical 
ideal critical value, X = 1 /t 6 , because of the require- 
ment for small finite stability margins, the need to 
limit the tracking errors to remain on the display, and 
due to secondary effects of the a phase contributions. 

6. For a given operator, the exact value of instability, X c , 
at which control is lost will depend primarily on x e and 
secondarily on a, as well as the limiting phase and gain 
margins required by that individual's random deviations 
around his mean parameters. If these margins and a are 
relatively invariant, then a calibratable relationship 
should exist between T e and X c . 

The development of a device for automatically determining the critical 
instability will be described next before going on to the experimental 
program. 
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SECTION III 

DEVELOPMENT dr THE AUTOFACED CRITICAL TASK 

It has been shown in the first section that a measure of the subject's 
effective time delay, T e , can be obtained by noting the value of the 
unstable root at which the subject can no longer maintain control in a 
tracking situation. It is a primary objective of this program to evolve 
a method and test configuration for increasing the unstable root from an 
easily controlled value to the critical value while the operator tracks 
continuously. An obvious approach is an automatic adjustment which not 
only relieves the experimenter of the job, but also prevents his bias 
from contaminating the data. Some of the key considerations in the develop- 
ment of the final test configuration will be reviewed in this section. 

A. CRITERIA 

The main criterion is that the measured value of the critical divergent 
root, X c , should be dependent only on the human operator's effective time 
delay, x e , and not on the detailed mechanization of the critical task. 
Specifically, the value measured should not depend significantly on the 
selected display parameters, the adjusting device operation, or the modus 
operandi . Variations in X c with secondary task variables such as run 
length, input characteristics, and control gains are expected; hopefully, 
these variations can be minimized or standardized by proper selection of 
the task parameters. Other criteria included: 

• Simplicity of mechanization, to facilitate its exact 
duplication in other laboratories and to maximize its 
reliability. 

• Suitability for untrained as well as trained operators 
without experimenter adjustment » 
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B. ROOT ADJUSTMENT SCBSMBS 

During exploratory phases of this program, documented in references 17 
and 19, several root adjusting schemes were tried with varying success. 
Adjustment "by the experimenter, as originally used in the 1961 critical 
task development, was eliminated as too cumbersome and unrepeatable. 

Self -adjustment of X by the subject himself was found to be unworkable 
because no workload margin exists for the adjustment process as criti- 
cality is approached. The most successful schemes are those depending 
on the predicted (and observed) sudden increase in tracking error per- 
formance as x nears the critical value for a particular operator. 


Three performance feedback schemes for changing the root increase 
rate, x, were: 

: ( e c - |e|) (52) 

: ( e c - l e l) 2 SS 11 ( e c “ l e l) (33) 


Scheme A: 
Scheme B: 
Scheme C : 


X = k| 
X = k( 
X = k| 




fe - H -.- 

r (Tfs + 1 )j 

where "e" is the tracking error (seen by the subject as a vertical dis- 
placement of a horizon-bar-like line on a CBT, |e| is its rectified 
value, and e c is a preselected "criterion" error level. Scheme A mecha- 
nizes the concept that, for very small errors the subject is certainly not 
near his stability limit and X should thus be increasing, while for 
excessively large errors the subject is just losing control and there- 
fore X should be decreasing. The divergent root should stabilize at 
the subject's average minimum controllable value, X = X c , and hence be 
proportional to i/t 6 . A number of difficulties with this scheme became 
apparent as the experiments proceeded, and are discussed in the following 
paragraph. 
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The principal difficulty with Scheme A was the large range in the 
rate of increase, i. For the initial values of 1 the rate was too low, 
while near terminal values the rate was too high. The total effect, then, 
is that the subject is required to spend the majority of his tracking time 
just in getting the root out near the "critical" region. The number 
obtained in this manner is undesirable from two standpoints: during the 

long initial time the subject can tire, and a fast final rate gives an 
optimistic (or high) value for X c . This last point can be demonstrated 
by using an adjustment rate so high that, even with hands-off control, 
a significant X c is obtained before the display diverges to its limits. 

Scheme B was evaluated in hopes of correcting the rate deficiency, 
but a new problem arose — that of interaction. When the gain was high 
enough to get a good adjustment rate, considerable coupling existed 
between the control loop and the adjustment loop (the divergent root 
"chased" the error level) . 

Smoothing the error (Scheme C) was of no help since the additional 
lag created stability problems in the coupled subject-adjustment loop. 


The best solution to these problems was found to be an adjusting law 
which was not a feedback function of the error. A two-rate law was 
evolved, of the form: 


Scheme D: 



= k-| 


= k 2 


TfS + 1 


< e. 


TfS + 1 


> e f 


ki > kg 


( 35 ) 
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The subject tracks while the root moves rapidly towards instability. 

When the filtered absolute error reaches a predetermined level, the 
rate is decreased to a creeping, "but irreversible, rate and continues 
until the subject loses control. This is similar to the action of an 
experimenter manually adjusting X toward the critical limit. 

The value of X at which control is lost can be considered to 
represent the short-term average of X c over the last few seconds of a 
run. Notice that the operation represented by Scheme D is equally valid 
for both the trained and the untrained operator since it depends only on the 
point at which performance deteriorates. Scheme D was used for the 
final experiments, and was termed the "autopaced test." 

Before discussing the parameter selection for the autopaced test, it 
will be helpful to discuss some error considerations. It is shown in 
the theory section that if the conventional pilot models are assumed with 
a fixed time delay, and if a maximum stability measure (such as gain 
margin) is maintained, the system rms- error- to- input ratio as a function 
of X will characteristically increase suddenly as shown in Sketch A. 



Sketch A. Characteristic error performance for critical task 
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Consequently, the error criterion e c , scope size, input, or visual angle 
limi ts can all place upper bounds on . If the results of any 
experimental program are to be independent of the mechanization of the 
experiment and equipment used, one must insure that these bounds are 
operator- centered (e.g., eyeball limits), and not machine-centered 
(e.g., scope size). 

C. PARAMETER SELECTION 

An attempt was made to desensitize the resulting X c obtained from 
the critical task to the crucial parameters of the configuration. 

Figures 7“ 10 show, respectively, the sensitivity to error angle seen 
by the eye, controlled element gain, amplitude of the input, and the 
input bandwidth. The knee is quite apparent in each set of figure 7 
(two different adjustment "laws" were used) and the available error 
display angle should obviously be greater than 10 deg. These runs 
had no input except operator remnant, so it is quite important that 
this minimum display angle be observed, because any input will further 
increase the error. 

During these runs to determine error limits, which involved various 
combinations of eye-to-CRT distance and CRT masking apertures, it was 
observed that the eye remains fixated on the null point, and the 
eyeball does not move to track the error display. Though the error bar 
traveled beyond ±30 deg of visual angle and, in some cases, the eye 
was only 5 cm from the CRT, the eye remained centered. 

Figure 8 shows that X c is fairly insensitive to control gain over 
a range of two orders of magnitude. (Remember that the operator 
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must compensate for the control gain to keep the loop gain within narrow 
limits.) The nominal value had. been chosen earlier from operator opinion 
rating, and was borne out by these data. The input am p litude, figure 9 , 
has a small but linear effect on X c , as does the bandwidth (fig. 10) of 
the input. Zero input seems to give the "best," i.e., most consistent 
and highest values of X c , but this setup is not feasible if describing 
function data are to be obtained. The input selection was then 
made on the basis of past human operator response studies (ref. 2 ) so 
that a direct comparison could be made between past T e data, data taken 
for this project, and autopaced x c values. 

The parameters k-j , k 2 > e c , and T-f of Scheme D were selected on the 
basis of X c data and operator opinion. The optimum combinations seem 
to be readily apparent to ^he subject. He is quite aware of when the 
rates are fast enough to give the optimistic reading mentioned below 
and when the rates are too slow he immediately complains and the 
data become erratic. An optimistic X c can be obtained by raising the 
root adjustment rate too high. The extreme case would be demonstrated 
by having a rate so high that, even for a "hands-off" condition, a 
significant X is obtained before the divergence causes the task to cease. 
This condition was avoided by making subjective measures, as noted above. 

An additional feature found very desirable is a dot operated by a 
second gun in the CRT, which moves to the right from the origin propor- 
tional to x, analogous to the root location in the s-plane. The subject 
can thus observe an increase in X and monitor his score (the dot holds 
at X c ) . Good operator incentive is provided by this feature, combined 
with instructions to "equal or better his previous score." 
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1 « Mechanization 


The final configuration for the critical task test based on the 
development just discussed is shown in block diagram form in figure 1 1 , 
while the parameters are given in Table II. The gains were chosen on 
the basis of the appropriate angle at the eye, which is, of course, 
directly related to the scope size (maximum displacement of the CRT 
used is ±4 cm) . The value of e c should be about 1 0 to 20 percent of 
the max imum scope deflection. This allows the operator to get to within 
1 or 2 rad/sec of X c before the adjustment rate kg switches in. Although 
the operator should track at the rate kg for at least 1 0 sec before he 
loses control to insure a nonoptimistic reading, tracking for much more 
than 100 sec would probably bring the onset of fatigue and other undesir- 
able long term variations. 


TABLE II 

NOMINAL AUTOPACED CRITICAL TASK PARAMETERS 


K 1 

«d 

K s 


k 1 


kg/ki 


Tf 


= 0.J66 cm scope deflection/volt 

= 57-3/<i, degrees display displacement at eye 

per centimeter of scope deflection 
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To minimize the neuromuscular lags and to provide an isometric 
(no deflection) restraint on the operator's muscles, a rigid force stick 
is preferred. The force stick used for the tests reported herein is a 
Measurement Systems, Inc., Model 4 35 control stick. Its low mass and 
sensitive response allowed relatively high frequency responses to be 
measured. 

This test configuration has been mechanized on general purpose analog 
computers at both Systems Technology, Inc., and The Franklin Institute. 
About 17 amplifiers , 11 potentiometers, 1 multiplier, and 5 relays are 
required for the complete circuit (shown in Appendix B) . 

D. OPERATION 

An autopaced critical task test begins with the operator in place and 
grasping the stick. The root instability is initially set at a finite 
low value to insure operator attention. When the rectified and filtered 
error builds up to the preselected value, the rate of increase of X 
decreases but X continues to creep outward until control is lost. When 
control is lost, the error goes off-scale and the computer holds, giving 
a reading for X c . 

Figure 12 shows typical time histories of autopaced runs with and 
without an input. Points of note are the relatively random appearance 
of the input, the very random appearance of the error and its sudden 
increase past e c followed by the decrease in X, the similar appearance 
of the traces with and without an input, and the moderate time required 
for the complete run (less than 1 min). 

The final system proved to be very reliable and satisfactory for a 
number of different subjects of various skill levels who tried it out. 
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SECTION IV 


EXPERIMENTS 

There are essentially two objectives to the experiments reported 
herein. The primary objective is to establish that the autopaced criti- 
cal task indeed provides some measure of T e . Second, an explanation and 
description of the operator's behavior near incipient instability are 
desirable to further extend the work of reference 2. In attaining these 
objectives, the experiments are aimed at 

• Observing X effects on the human operator's behavior, 
as measured by describing function and performance data 

• Correlating autopaced data with describing function data 

The experimental program was carried out in three phases: 

1 . An exploratory group of experiments was performed as 
just described, using the STI simulator, to determine 
the optimum controlled element configurations, the best 
adjusting scheme for X, and the optimum parameters. In 
addition, some very rough checks of intersubject differences 
and task learning times were made (ref. 19). 

2. A group of preliminary describing function runs was made 
at The Franklin Institute to verify the duplication of 
the STI test configuration, and to provide a check on 
the similarity between the behavior of the test subject 
and past subjects in similar tasks. 

3- The main experiments, performed at The Franklin Institute, 
included both autopaced x c and describing function data, 
with emphasis on variations in X and input. 

In the remaining portions of this rather lengthy section the most 
important results of Phases 2 and 3 will be covered (the exploratory 
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Phase 1 work has been documented in references 1 7 and 1 9, and was discussed 
briefly in the previous section) . After reviewing the over-all experi- 
mental design, the autopaced data will be presented, then the describing 
function measurements, their curve fits, and resulting parameter trends 
will be given. The interpretation of these combined results will be 
discussed in the final main section. 

A. IXPERIMSRTAL DESIGN 

The scope of this program was too small to consider a massive, 
statistically designed experimental program to cover all variables of 
inmediate interest, i.e., subjects, number of trials, input bandwidth and 
level, degree of instability, run length, etc. In fact, not enough was 
known at the start to even guess at the levels and replications required 
for a rational Statistical design. Consequently, emphasis was placed on 
key preliminary experiments which would validate the crucial assumptions 
and provide sufficient insight and data on which to base subsequent 
theoretical analyses and detailed experiments. 

While the exploratory experiments of Phase 1 showed distinct 
individual differences in the achievable autopaced X c scores, these and 
the previous experiments on subcritical first-order tracking tasks indi- 
cated that the basic forms of various operator's describing functions 
were similar and reasonably well constrained by this task (see ref. 2). 
Consequently, it was decided to use a single subject, provided that the 
describing function form was shown to be similar to that of other oper- 
ators under previously tested conditions. As will be shown later, this 
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agreement was established, and therefore the limited experimental time 
could be used to increase the reliability of one subject's data. 


The most important variable was the unstable root, X. For the 
describing function runs, four values of X (2, 3, 4, and 5 rad/sec) were 
chosen to span the region between the previous data of reference 2 and 
the limit at which runs of reasonable length could be made. 

Based on the Phase 1 experiments and on the results for subcritical 
tasks in reference 2, it was felt that the input bandwidth would have a 
secondary effect; most of the describing function and autopaced data 
were measured with one basic low-bandwidth (o>j_ = 1.5) input spectrum, but 
a few describing functions were measured at a higher bandwidth (<r£ = 4.0). 
Of course, no describing function data could be measured with zero input, 
because cross -correlation of the signals with the input is required. 
Because the Phase 1 autopaced data, as well as the theory, indicated that 
there would be some effect of input level, the main autopaced runs were 
made with and without the basic input. 

A matrix of experimental variables and the number of replications 
made at each condition is given in Table III. 


TABLE III 

MATRIX OF EXPERIMENTAL CONDITIONS 


INPUT BANDWIDTH, 
o>j. (rad/sec) 

LEVEL OF INSTABILITY, X (rad/sec) 

2 

5 

4 

5 

Maximum Achievable 

No. of I 

)escribii 

ig Funct: 

Lon Runs 

No. of 

0 

— 

— 

— 

— 

45 

1 -5 

3 

2 

9 

3 

k-6 

4.0 

— 

- 

4 

- 

— 
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The procedural design consisted of a series of several simple 
experiments in which one variable was changed during each day's testing. 

Thus, X was the dominant variable on one day and on another. One set 
of conditions was established as a "base ran" case which was included in 
each day's runs. By this means it was possible to obtain a large number 
of replications of one case to establish its intrinsic variability, while 
permitting a more economical number of runs across the variables of 
interest . 

During each day's testing, the autopaeed critical task was run (with 
and without inputs) at the start and end of the day. To balance out 
fatigue and presentation order effects, the describing function runs (which 
were limited to less than a dozen per day by the complex procedures involved) 
employed a randomized order of presentation of the dominant variable in 
the morning, and the reverse of this in the afternoon. A detailed run 
log is included in Appendix C showing the chronology of the data reported 
herein . 

B. AI7T CEP AGED Xc DATA 

The first data to be presented are the results of the autopaeed runs. 

The automatically paced and scored setup described in an earlier section 
was used for all these trials. Near the end of the Phase 1 experiments 
at STI, the subject, an engineer and private pilot, was given a large 
number of trials to insure thorough learning of the task. It has been 
found that the autopaeed critical task provides an excellent training 
device because it demands constant attention, always progresses to the 
subject's skill limits, and engenders strong motivation to achieve a high 
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score. For simplicity, these trials were all made without a command input 
the subject's remnant was ample excitation, as is shown in figure 12. 

Experience with the exploratory trials of Phase 1 had shown that from 
three to five autopaced runs should be made in one samping of X c . Aver- 
aged over five subsamples, the mean for successive samples, X c , is quite 
stable over a large number of trials in any given time interval on the 
order of an hour or two. The five-trial means and standard deviations 
for X c during the learning trials are shown in figure 13. 

No statistical analyses of these training data were attempted, but 
the following points were apparent: 

1 . The initial learning time, to get out to a critical 
instability of X c = 5 s was quite rapid — on the order of 
a few trials. 

2 . Subsequently, over a month's time and over 1 70 trials, the 
controllable divergence gradually rose to a level near 

X c == 6.5 ± 0.7 and leveled off. 

3. The trial-to-trial variance (as evidenced by the trend in 
the standard deviations) was appreciable, being partly 
attributed to the lack of warmup and loosely controlled 
training procedures. 

4 . Although some large fluctuations in the five-trial means 
were noticed, no attempt was made to formally correlate 
these particular data against time of day or other 
subject-centered variables which might conceivably have 
an effect on X c because no pattern is evident among the 
coded points of figure 1 3 • 

Other unpublished learning curves show similar trends, i.e., that 
initial learning is quite rapid and X c stabilizes at a reasonable level 
after several dozen trials. 
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During the course of the main experiments at The Franklin Institute, 
which spanned several days, five-trial autopaced data were taken at the 
start and end of each day. These data are shown plotted chronologically 
in figure 1 4. Runs were made with and without a standard random- 
appearing input, and a small "but consistent difference in X c is apparent. 

Except for the first set of runs (with input) , the levels of X c appear 
to be essentially the same as the previous set made at STI (note the 
mark on figure 14 indicating the terminal level of the learning trials 
from figure 13). These data, as well as the subject's reports, suggest 
that the autopaced test configuration and data can be duplicated easily 
even in widely different facilities. 

Some simple statistical analyses of the main data were made to establish 
the distribution of variance, to determine the independence of run- to-run 
variations in X c , and to check any trends in the data. First, a standard 
RUNS test was made to verify that the variations about the mean within 
each five-trial sample were randomly ordered (ref. 20, Table II, p. 298). 

The test showed that the deviations were random, (in the worst case, the 
test statistic u = 25was within the 90 percent confidence interval.) 

Histograms of the individual trial differences from their five-trial mean 
are shown in figure 15. A test, of goodness of fit was made on each 
set to verify whether or not these deviations could be considered normally 
distributed (Gaussian) . The test showed that with 26 degrees of freedom in 
each case, 'i? was well within the 95 percent confidence interval, and that 
the two sets of data are normally distributed (with no input, - 11 .27; 
with input, = 13-8; while the 5 percent reject levels are = 30. 1 and 38* 9> 



respectively. ) The reason for choosing k c rather than 1 /l c = x e for 
analysis is as follows: The recent large scale, simple reaction time 

(RT) measurements reported in reference 21 show definitely that l/RT, 
rather than RT itself, is normally distributed. The reason given is 
that the ET deviations should depend primarily on the velocity of 
propagation of signals along neurons, which might be expected to be 
normally distributed about a mean velocity. The average velocity would 
be measured by (distance/RT) , thus 1 /RT should have a normal distribution. 
If an analogy between RT and r e is drawn, then X c , which is roughly 
proportional to 1 /t q , might also be normally distributed about its 
mean value. The results herein support that hypothesis. 

One further conclusion can be drawn from the histogram data: the 

standard deviation of a typical trial value of \ c from its sample mean is 
a reasonably small percentage of the mean. Taking the over-all test means 
for each input case as a reference, the specific values are: 

Standard / std. Dev. 

Mean Deviation \ Mean 

Wo input 6.58 ±0.31 4. 7^ 

With input (B6 1 — 1 .5 — 1/8) . . 6.00 ±0.39 6 . 50 $ 

These percentages are lower than those experienced in most simple 
response time measurements, where the standard deviations are typically 
10—13 percent of the mean under the best of conditions (ref. 22, p. 38 ). 
Consequently, fewer trials are needed to establish a mean to specified 
precision with the autopaced critical task, and it should be an efficient 
substitute for reaction time measurements in situations where tracking is 
important . 
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From inspection of figure 1 4 it is apparent that, except for a couple 
of samples, the level of X c remained remarkably constant across all the 
test days. Consequently, the over-all means for each input case can be 
tested for the significance of their different means. Since the distribu- 
tions have been established as normal, the normal statistic (t = difference 
in means — standard error) was used. This test gave a value of t- = 5 = 25, 
which is far beyond the value of t (t = 2 . 57 ) for a 99 percent confidence 
interval. It is concluded that the small systematic reduction in X c due 
to input is statistically very significant. 

In fact, it turns out that almost all five- trial sample means are 
probably different, albeit slightly, from the over-all mean (as determined by 
Student's t test). Except for the obvious law initial set and anomalously 
high (but carefully checked) last two sets of runs in figure l4, the 
implications of this last finding are that the day-to-day, and even 
morning- to-afternoon, differences in T e might be readily detectable by 
this technique. This interesting possibility should be studied further. 

The interpretation of the measured X c in terms of x e , and its correlation 
with other data, will be done in a later section. 

In closing this subsection, the following conclusions are drawn: 

1 . The autopaced critical task developed herein, as well as 
the resulting X c scores for a given well -practiced subject, 
can be closely duplicated at various facilities. 

2. Five-trial sample means for X c are very stable, and the 
variance is remarkably low. This precision implies that 
the autopaced critical tasks would be a very efficient 
psychomotor test. 
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J. Learning is rapid, with several dozen trials being sufficient 
to reach the asymptotic score level. An essentially constant 
level of \ c was observed throughout the experimental program. 

4. The test can be run without a command input, using the sub- 
ject's remnant "noise" to excite the system. Although the 
test seems subjectively the same as with an input, the X c 
scores without an input are about 10 percent higher than 
with a standard B 6 '— 1.5 — 1/8 input spectrum. 

C. DESCRIBING FUNCTION MEASUREMENTS 


Technique . — To validate the theoretical model and assumptions, 
measurements of the operator's describing function were made. The subject 
tracked a random input with a first-order divergent controlled element 
at various fixed levels of instability up to the limiting level which he 
could track continuously for 2 to 4 min. The describing functions were 
measured by the cross-spectral analysis technique, using the watthour 
meter (WHM) analyzer at The Franklin Institute. A complete description 
of the cross-spectral analysis method and the WHM analyzer is beyond the 
scope of this report, and the reader is referred to references 2 and 23 
for details on the method and equipment. By directly measuring the time- 
averaged cross-spectra between the displayed error and the command input, 
$ie > an d between the pilot's control output and the command input, 
$>j_ c (a>), the pilot's describing function is computed from 




®i C M 


(56) 


A run length of 4 min. is used for most measurements to provide an 
adequate number of the low frequency cycles over which to perform the 
averaging required by the cross-spectral technique. 
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Input . — Some input is required for describing function measurements, 
and a sum of many sinusoids is required for the WHM analyzer. By using 
nonharmonic frequencies and random phases, random appearance of the input 
and resulting displayed error are assured, thus guaranteeing pure compensa- 
tory behavior by the human operator. Inputs are required at each frequency 
at which the describing function data are desired, vet too large an input 
bandwidth will cause the operator to "regress" and to smooth over any large 
high frequency inputs. The solution, originally used in reference 16, is 
to employ a set of dominant low frequency waves to provide the effective 
input bandwidth, plus a number of very small high frequency waves which 
the operator can barely detect but which he cannot avoid responding to. 

The specific input consisted of the sum of ten sinusoids. The 
spectral shape is shown in Sketch B, and approximates a dominant rectangu- 
lar bandwidth whose highest frequency is u>l. This particular shape has 
been identified by the code b6'— — a, where B 6' refers to the shape 

(ref, 16 ), axj_ is the bandwidth, and a is the rms value in display units. 

The rectangular-plus -shelf type of input spectra typified by the b 6' input 
have been used previously in human response programs, and have been found 
to be good approximations to a random input. For example, the data in 
reference 2 show that the input amplitude distributions are essentially 
Gaussian, and tha t the resulting closed-loop error distributions, which 
are what the pilot actually sees, are also Gaussian. 
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Sketch B. Input spectrum (b 6' shape, a>j_ = 1 .5 fad/sec) 
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Experimental Setup and Procedure. — The describing function measure- 


ments were performed with the same experimental apparatus as the autopaced 
critical tasks (see section IV-B and Appendix B) . The operator was started 
at an easy subcritical level of instability, which was then moved out to 
a preset level of 1 = 2, 3, 4, or 5 for each run by the autopacer. At 
this point the WHM measurements started and continued for 4 min. (except 
for X = 5* where only 2 min. runs could be completed). About a dozen or 
so runs were obtained during a morning and afternoon session each day. 
Mean-squared tracking error and mean-squared control force were also 
measured during the run. As mentioned previously, the order of presenta- 
tion of each level of X was randomized and counterbalanced during each 
day's running. A run log of the test conditions is contained in Appendix B. 

Tie-in with previous data . — Because the experimental design was con- 
fined, for economic reasons, to a sampling in depth of one typical operator, 
it was important to verify that this operator was typical of others. 

Figure l6 compares typical describing function data (plotted as Yq L , the 
open-loop describing function during the closed-loop tracking task) of 
four pilots and one engineer during the similar subcritical tasks of 
reference 2 (open symbols) with those of the present operator (solid 
diamonds) . The task differences were mostly limited to the apparatus, 
as follows: (a) The control stick in the current experiments was a rigid 

force -pickoff pencil stick operated fore and aft; whereas, a light, stiffly 
sprung handle operated about the lateral (roll) axis was used in the previous 
cases, (b) The error was displayed by vertical displacement in the 



present case, versus horizontal displacement in the previous experiments. 

(c) The input had a lower rms level in the present experiments; otherwise 
the inputs were essentially identical. 

The difference between the present and the previous data (fig. l6) is 
small and is consistent with the tighter neuromuscular loop permitted "by 
the isometric force stick. This is evidenced by slightly larger gain and 
phase shift at low frequencies and a higher frequency for the neuromuscular 
second-order term. It is concluded that the present experimental subject 
is typical of the population of pilots for which this critical task is 
intended. 

Seme idea of the sub ject-to-sub ject variability is also apparent from 
figure 16. The wide phase scatter at the lowest frequency is due primarily 
to intrinsic measurement accuracy limitations imposed by run length. The 
lower variability near the crossover region is apparent, and is partly 
explained by the "selective variability" hypothesis of reference 2, 

(which states that the operator's behavior is the least variable in the 
crossover region) especially if the system closed-loop stability is 
marginal, as it is here. 

Describing function data • — In order to verify the theoretically 
predicted trends in the parameters describing the operator's behavior, as 
the instability was increased toward criticality , the raw describing func- 
tion data were averaged and curve-fitted. To show the run- to- run vari- 
ability expected among runs taken at various times, the four individual 
Yp data plots comprising one data set are shown in figure 17a. This 
condition (x = 4 and o>i = 4 rad/sec) provided a very consistent set of 
runs, and the snail scatter shown is usually within the accuracy of 
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the WHM cross -spectral analyzer.* Again, the reduced variability in 
the crossover region is notable. 

The averaged data from figure 17a are shown in figure 17b along with the 
resulting standard deviations. The data of figure 17a are also curve-fitted, 
using the three previously described human operator models. The parameters 
for these three curves have already been given in eqs. (12), (l 6), and (18). 
The data points show features requiring the precision model of the operator 
(solid line) to account for the entire frequency range, since there is some 
low frequency lag and amplitude rise and a high frequency second-order peak. 
However, the extended crossover model (dashed line), hereinafter called the 
"a-model" for brevity, fits the data in the crucial stable region around 
crossover frequency. It is used for the remainder of the data because it has 
fewer parameters to adjust and yet covers enough of the frequency domain 
to validate the theory. First, the mean pilot describing functions Yp(jcn) 
were fitted for phase (using special templates for combined t and a 
effects), giving a and r e contributions; then the amplitude was fitted 
near cue, giving the pilot gain, K^. Next, the corresponding open-loop 
YpY c curves were drawn through the open-loop describing function data, per- 
mitting analysis of the various stability margins. "Best fit," but some- 
what arbitrary, fairings were also put through the actual YpY c data points 
to check the consistency of the actual and fitted trends. 


It has been noticed in previous and present work that tha input 
tiij[ *= 4.0 cases usually have lower scatter than the o>l =*= 1 .5 cases, but it 
is not clear whether this is due to the input bandwidth, the larger num- 
ber of waves in the o>j_ = 4.0 case, or to apparatus errors resulting from 
the different WHM analyzer power levels used in each case. 
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The remainder of the averaged describing function data taken at other 
values of X are presented in figures 1 8 through 21 , first plotted as Yp 
and then as Y p Y c in order to facilitate assessment of both the model fits 
and loop closure criteria. It is obvious that neither the ct-model nor any 
other model will fit some of the erratic phase points, yet the values of 
the actual and fitted stability parameters are fairly consistent. Detailed 
discussion of these describing functions will be delayed until the collec- 
tion of fitted data parameters has been reviewed. 

Data parameters . — Table IV contains a summary of all the fitted 
parameters, while figures 22 — 25 show the comparison between the actual 
and fitted data. The reader should mentally weight the X = 2 and 4 data 
points more heavily, since the X = 3 data are an average of only two r uns 
and the X = 5 data are made up of three short runs (2 min. and less) . The 
short run lengths mainly increase the low frequency variability. 

Note, in figure 23, that seems to demonstrate contrary trends between 
actual and model data. This is not considered significant because the 
measured points are very sensitive to the fairing of the mid-frequency 
phase curve. Although scatter exists in the other data, most of the 
trends are consistent. One conclusion is, then, that the a-model 
provides a sufficiently accurate fit to human operator describing 
functions measured while performing subcritical and critical tasks. 

The parameter adjustments exhibited by the operator can now be 
extracted from these cross-plots. In view of the remarks made above 
(regarding weighting of data in favor of the X = 2 and 4 runs), we can 
conclude that a, to a first-order approximation, is constant. The 



TABLE IV 


FITTED PILOT MODEL PARAMETERS, LOOP CLOSURE CRITERIA, 
AND TRACKING PERFORMANCE MEASURED DURING SUBCRITICAL TASKS 


Instability, X (rad/sec) 

2.0 

3-0 

4.0 

5.0 

Input bandwidth, (rad/sec) 

1 -5 

1 -5 

1 .5 

4.0 

1 -5 

a-model parameters 

Pilot gain, Kp (linear) 

2.60 

2.65 

1 -73 

1 .90 

1 .67 

Effective time delay, r e (sec) 

0.121 

0.111 

0.110 

0.116 

0.100 

Low frequency parameter, a 
(1 /sec) 

0.35 

0.4i 

0.35 

O.36 

0.31 

Stability criteria 

Crossover frequency, cup 
(rad/sec) 

5-0 

7.5 

5.1 

6-7 

7-1 

Lower stable frequency, uu-| 
(rad/sec) 

0-99 

1 .40 

1 .65 

1 .8 

1 .44 

Upper stable frequency, 

( rad/ sec) 

11 .0 

10.9 

10.5 

1 1 .2 

11-3 

Lower stable gain, K u ^ 

(linear) 

1 .11 

1 .11 

1 .07 

1 .15 

1 .05 

Upper stable gain, K U £ 

(linear) 

5.4 

3.8 

2.9 

2.7 

2.3 

Gain margin, Km (dB) 

6.5 

3.0 

4.0 

4.0 

3-0 

Phase margin, cp^ (deg) 

30 

16 

1 4 

14 

12 

Performance 

RMS: error/input, e^/i^s 
(cm/cm) 

0.80 

0.93 

1 .79 

2.08 

2.34 

RMS: control/input, c rms /i rms 
(cm/cm) 

2.53 

2.58 

3.08 

3-73 

3.32 

RMS coherence, p„ 

8, 

0.74 

0.47 

0.67 

0.74 

0.78 

Normalized parameters 

Relative instability, Xx e .... 

0.242 

0.333 

0.44o 

0.464 

0.500 

Relative a; a/r e 

0.042 

0.046 

0.038 

0.042 

0.031 
























variation of T e with X appears to be almost linear. Note that the model 
fits to the data make no implications on the limiting or minimum value 
of T e achievable by the subject, but only provide a basis for extra- 
polating beyond the conditions for long continuous runs, as required 
for the describing function measurements. Other considerations, to be 
discussed later, are involved in determining the minimum attainable 
by the subject. 

The carefully considered, but somewhat arbitrary, extrapolation of 
the data to the limiting value of X c in the autopaced experiments is 
also shown on each of the cross -plots for use in later discussions. 

The relative tracking error, as measured by the ratio of the rms 
tracking error to the rms command input (both referred to the display 
CRT), increases with X as shown in figure 26a. Similarly, the control 
effort, as measured by the ratio of rms pilot output (in force units 
referred to the display) to rms command input also increases with X. 

Noting that the majority of the pilot output is represented by a nearly 
constant gain amplitude ratio in the describing function plots, it might 
be expected that Crms/ e rms = Kp, even if remnant were present. This 
comparison is made in figure 26b, where it can be seen that the trend of 
each with X is similar and that the magnitude of measured [control/error] 
(rms), approximates the loop gain. 

This correspondence offers an extremely easy way of checking that 
Kp is in the prescribed region. In experiments where the critical task 
is used to constrain the operator's behavior, but where describing function 
or parameter tracking measurements sure not available, either c- r mR /r T ^ n g or 
| c | / 1 e | could be used to give a close estimate of Kp . 
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Figure 27 shows the variation of the relative coherence coefficient, 
p , which is a measure of the portion of pilot output linearly correlated 
with the input relative to the total pilot output. As shown in 
reference 2, 





(37) 


where c^ = the mean square total pilot output 

n^ = the mean square remnant (i.e., that portion not 
accounted for by the describing function acting 
on the input) 


Remember that, by definition, the describing function accounts for 
any simple nonlinearity in the operator's behavior. The remnant is left 
to account for the effects of random variations in the operator's 
adjusted parameters, and especially the variations in delay time [r r (t) 
of eq. (l )] . Thus, p a is an indicator of the relative remnant in the 
operator's control signal in an rms sense. 

It is apparent from figure 27 , where p a varies from 0.5 to 0.8, that 
the remnant constitutes a relatively large fraction of the operator ' s 
output in these experiments, which is probably due to the relatively 
small input (aj_ = 0.32 cm here, as compared to 1 .3 cm in reference 2 
where p a = 0.8-0. 9). Weighting the X = 2 and X = 4 data gives a slight 
decrease in p a as the instability is increased. The level of p a in figure 
27 at X = 2 is slightly lower than the value measured in reference 2 for 
the comparable case with Y c = 2/(s - 2)(0.74 versus 0.8 + ), 

This concludes the presentation and analysis of the describing function 
data. These results will now be compared with the autopaced X c data and 
the theoretical analyses in order to interpret the results, test the 
original assumptions, and refine the basic theory. 
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SECTION y 


mmsmixnm oar results 

A. VALIDATION OF THE THEORY 

In this section the experimental data will first be interpreted from 
the standpoint of the key theoretical assumptions and derived predictions 
presented at the end of the "Theory" section. Finally, some refinements 
to the theory required by experimental results will be discussed. 

The six theoretical predictions in Section II -F will be assessed 
in successive order. The first relates to the low run-to-run variance 
to be expected on the basis of the narrow range of Y permitted by 
stability considerations. As shown by the variances marked on the 
describing function data of figures IT — 21 , in the important crossover 
frequency region between 1 and 10 rad/sec the run-to-run variance is 
relatively small (on the order of a few symbol widths) for a given X. 

Figure 16 showed that the variations from operator to operator are 
comparably small (especially when it is noted that the controlled element 
gains were changed for each operator in the previous experiments, requiring 
compensating operator gain adjustments). As regards the trend in the inter- 
run or interoperator variances with level of instability, the different 
number of runs at each X makes numerical comparison difficult. Purely 
on the basis of a subjective evaluation of figures 18 — 21, it is felt 
that there is no really significant increase in variance with X. Thus, 
the first set of theoretical predictions seems to be supported by the 
data. 
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The second prediction was that the tracking errors should increase 
and stability margins would decrease as the instability approached its 
critical value. A comparison between the theoretical curves of figure 5 
and the observed stability criteria of figures 24 and 25 shows there is 
a clear validation of the prediction of decreasing stability margins. 
From figure 26a it is also apparent that the relative tracking error 
increases as X approaches its critical value, as predicted in figure 6. 
The second set of theoretical predictions has thus been clearly vali- 
dated. 

The third theoretical prediction was that a tight neuromuscular 
loop would result from the stress of controlling an unstable element. 

A tighter kinesthetic (force feedback) loop would lead to increased 
<x^, lower higher 1 /Tjj, and higher a (due to a larger difference 
between 1 /T^- and 1 /T^) . The present data indicate that a lies between 
0.5 and 0.4, a relatively high value compared with that of a = 0.2 
given in reference 2 for Y c = 2/(s — 2) . The apparent decrease of a 
with X shown in figure 22a may only be scatter, as noted previously, 
because the data variance increases at frequencies below , where 
the a phase contribution is fitted. According to the precision-fit 
data shown in figure 1 7> for X = 4,, the values of Tjj, and T g 

are all consistent with a tighter neuromuscular loop than the X = 2 
values in reference 2. (Part of this difference may be due to the 
very stiff force stick employed for the present experiments as 
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compared with the spring-loaded stick used in reference 2) . Taking 
into consideration the operator's subjective impression of increasing 
his muscular tenseness during the autopaced runs, the third prediction 
is considered firmly supported by these experiments. 

Prediction No. 4 was that for Y c = Kc/(s —\) the operator's adaptation 
would be pure gain (nonequalized) in the broad crossover region and would 
be constrained to a narrow range of gains. The describing functions for 
Yp plotted in figures 17a — 21a clearly demonstrate the predicted constant- 
amplitude behavior in the broad crossover region. As was shown previously, 
the differences at very high and low frequencies are well accounted for 
by the neuromuscular terms in the precision model. The gain adopted by 
the pilot (K,t in the precision model, or K p in the o-model and simple 
model) is well within the stability limits predicted theoretically in 
figure as shown in figure 25* Even the limiting values of stable 
gain, which are measured from the describing functions, agree surprisingly 
well with the predictions of the simple model (using the observed t^s in 
conjunction with figure 5 or equation 26 to establish K^) . The differences 
are easily explainable too. The lower gain limit occurs at a higher gain 
because of a slight adverse effect of the low frequency phase on the lower 
gain l imi t (e.g., trace out the phase for the simple model and a-model 
curves in figure 1 7b) • The upper gain limit is reduced because of the 
amplitude departure from that of the simpler models as the neuromuscular 
second-order peak is approached.* 

*A slight additional overestimate in the theoretical was found 
to result from using the first-order Pade expression to approximate x e 
in the analysis of equation ( 26 ), on which figure 5 is based. 
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Of the possible pilot closure criteria suggested by theory (i.e. , 

Kpj^, q 0 , etc.); comparison of figures 5 and 25 indicated that 

the maximum gain margin criteria are used, since Kp roughly follows K^. 

The very clear proof of the predicted constraining effect of the critical 
task on operator adaptation is one of the most important results of these 
experiments. 

The fifth prediction was that the maximum instability which can be 
tracked for a given length of time would be less than the theoretical limit 
of 1 i 0 . 8 /t 6 because of finite gain and phase margin requirements. This 
is obviously true for the describing function runs, where the maximum 
instability which could be continuously tracked for 2 min. on 50 percent 
of the attempts was only 1=5 for a fitted 1 /x e =10. 

Consider next the extrapolations of the x e data in figure 22 , and of 
the phase and gain margin data of figure 24 , to the critical short term 
instability, \ c = 6, as measured by the autopacer. It is apparent that 
finite margins must still exist during the final few seconds of the auto- 
paced runs. The value of X c = 6 is consistent with the »on-zero stability 
margins, according to figures 5 and 25. A somewhat tenuous further 
extrapolation of these stability margins to their zero point would give 
an intercept around X = 10 to 12, which would be consistent with l/x e = 10 
to 1 1 . The theoretical implications of finite stability margins are thus 
borne out, but the surprisingly high margins still apparent for the 
autopaced data require further explanation. This will be given in the 
final subsection. 
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The final theoretical prediction was that the autopaced limiting X c 
would, depend primarily on 1 /t 6 and only secondarily on the effects of a 
and stability margins, i.e., there should be a calibratable dependence 
of X c on t 0 . The validity of this prediction depends on the smallness 
and relative invariance of T e , and the stability margins required as X 
is increased to X c . If the operator could track for several seconds 
with zero stability margins, and if a were constant for an X near X c , 
then X c would approach the ideal limit which could, in turn, be precomputed 
from the typical values of a from equation (31). However, these experi- 
ments show that appreciable stability margins exist even at X c , so the 
universality of any functional dependence of X c and T e then depends on 
the universality and consistency of the limiting stability margins and 
the level of a. The present data are too limited to draw any firm 
conclusions at this point. The slight variation of a versus X in 
figure 22a may or may not be significant for reasons noted previously. 

If it is assumed constant for a given experimental setup, then only the 
variations in stability margins from run to run, from operator to 
operator, and for various rates of change of X need to be examined. 

The present data indicate a fairly stable phase margin requirement 
for 4- min. runs at a given X, but the observed variation in tp^ with X 
in figure 24 makes extrapolation to a given X c less certain. Analysis 
of the variations in stability margin with run length encounters an 
uncertainty-principle limitation; the shorter the run length, the less 
accurate the cross-spectral measurement, and thus the intrinsic variation 
of stability margin at short run lengths cannot be resolved. 
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Average describing function data fits for several operators at 
nearly critical 1 would be required to determine the universality of the 
margins required at X c . This was beyond the scope of the present program, 
but is an urgent matter for future investigation. In short, the final 
prediction was not investigated in sufficient depth to permit its firm 
validation, and the few applicable data are vague. 

In summary, all of the assumptions and predictions of the critical 
task theory have been proven valid, except for one final point. Some of 
the reasons behind the apparently large discrepancy between X c and 1 / T e 
will be discussed next. 

B. THE DHTERENCE BETWEEN X c AND 1 /x e 

A major experimental result is the difference between the autopaced 
control limit of X c and the fitted describing function value of i/t s . 

As previously discussed in the "Theory" section, some of this difference 
is to be expected on the basis of low frequency phase effects . Let us 
now check this refined prediction. Extrapolating the measured describing 
function data of figure 22 to the autopaced limit of X c = 6.0 gives 
a| 1 0.35 l/sec, T e | = 0.09^ sec; thus ax e | = 0.037- The theoreti- 
cal ratio between the zero margin X and l/x e is then given by equation (31 ) 

aS: XT e = 1 - Vo. 037 = 0.8l 

The observed ratio of the autopaced limit X c to l/x e (extrapolated to X c ) 
is Xx e = 6.0(0.09^) = 0.57- In other words, given a and x c , the theory 
would indicate T e = (Xt)/x c = O. 81/6.O = 0.135 sec, while describing 
function fits indicate T e = 0.09X sec. 
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The apparent discrepancy can be explained by carefully examining the 
definition of average phase margin and its variation about a mean value. 
One source of variation in phase angle during a long run is the variation 
in operator time delay, T r (t) . Consider an operator who is tracking with 
a T varying every several seconds as shown in the sketch below. 



Sketch C. Hypothetical variation in t 

A describing function measure made over a long time compared to the 
period of the variation would yield a ~r = r e , or the average of the vari- 
ation. But imagine short time describing function measures (if it were 
possible to make such a measure accurately) . If the subject were in a 
subcritical task, a set of successive phase measurements of the describ- 
ing functions might appear as shown in the following sketch. 


w c 



Sketch D. Short time phase plots 
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Clearly, the subject would lose control whenever his t became as large 
as because it takes only a fraction of a second for the error to 
diverge off-scale. The Tij. is then the value that the critical task 
measures, while the T e is the quantity that the describing function 
determines . 


The actual source of the variation is not too important as long as it is 
realized that it is an operator-centered limitation. The tentative con- 
clusion is that the critical task measures an upper bound, or limiting 
value, of T e and not the average value. The fact that X c is so repeatable 
implies that a definite upper bound on T g exists. Consideration 
of the statistical implications of variability on X c is not within the 
scope of this report. To evolve a thorough treatment requires certain 
information about remnant which is not yet available, but is another 
area for further investigation. 


The apparent discrepancy between the measured T e and value indicated 


by X c can now be interpreted as a At due to the operator's intrinsic 


variability . 

Te X c = Te HF +AT 


(38) 


where Te- 
le 


the t computed via equation ( 31 ) from autopaced 
X c and a for tp^ = 0 


T e _— = the t obtained from extrapolating the describing 
function T e to Xc (fig- 22) 


At = a short term increment arising from the operator's 
basic variability 


For continuous describing function runs to be possible, this At 
requires that a finite average phase margin be maintained. This average 
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phase margin is given by: 


% = ^ ( T ex c " ^e DF ) 


(39) 


The measured data for these parameters are: 


<Pc 

Te ^c 

Te DF 


5-3 rad/sec (from fig. 23) 
0.135 sec 


computed from eq. (31 ) with 
X c = 6.0 and a = 0-35 


= 0.09^ sec (from fig. 22) 


Then, from equation (39) 


% = 5-3(0.135 “ 0.09^)57*3 = 12.2 deg 

The extrapolated average phase margin at X c in figure 24 is = 12 deg, 
in, perhaps fortuitously, good agreement with the computation. The 
conclusion is reached that the difference between the observed T e and 
r e predicted from X c is simply a matter of defining short run versus 
long run values of x e . 


6l 


SECTION VI 


CONCLUSIONS 


This combined theoretical and experimental investigation of a 
"critical tracking task" yields the following main conclusions: 

1 . The behavior of a human operator, while in a compensatory 
tracking task with a controlled element having a first- 
order unstable divergence, is accurately predicted by the 
servo theory of operator response (as given in ref. 2) 
even near* the point of incipient loss of control. 

2. As the degree of instability (measured by the inverse 
time constant, 1) is increased, the closed-loop stability 
margins decrease and the tracking errors increase, in 
good agreement with the theory developed herein. 

3. As the instability is slowly but continuously increased 
during one run, a point of incipient loss of control is 
reached, X c , which, for the operator tested, had a con- 
sistent level and low variability. A very satisfactory 
mechanization for automatically measuring X c is presented. 

4. This critical X c is theoretically shown to depend primarily 

on the operator's effective time delay, T e , while tracking. 
Both the analysis and experiments reveal that there are 
appreciable secondary influences on X c due to the operator's 
intrinsic stability margin requirements and neuromuscular 
system artifacts such as kinesthetic phase lags (a effects) 
and arm/control-stick resonances (o^, . The experiments 

were not of sufficient scope to show whether or not these 
secondary effects would preclude a universal dependence of 
X c on T e among all operators. 

5* The good agreement between the theoretical and measured 
operator describing functions proves that one can force 
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an operator to adopt any form of equalization and gain 
within his known capabilities by selection of a suitable 
critical task configuration. This should permit a 
variety of improved psychomotor tests to be developed 
in which the experimenter has excellent control over the 
operator's tracking behavior. 

More specific conclusions relating to the various phases of the 
program are contained at the end of each major subsection. 
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Block Diagram 
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Output 


Negative Feedback 




Simplified systems analysis of human' operator control 
of a first-order divergent controlled element 
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Figure 2. 

















Normalized Instability , Xr e 

0 .2 .4 .6 .8 1.0 



Figure 6. Theoretical tracking error growth 
as the open- loop instability is increased 
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(rad /sec) 



Figure 7 • Effects of maximum display size on \ c 
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Figure 8. Effects of stick gain on X c 
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O Input A = .32 cm ,rms 
Us Input A = .16 cm , rms 

Rectangular input spectrum 
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Input Bandwidth , w; (rad/sec) 


Figure 10. Input bandwidth effects on X c 
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Error 


Output 



a. No Input 


b With Input (B6-15- !fc) 


Figure 12. Typical Autopaced Critical Task Time Histories 
With and Without an Input 





Terminal Level X r = 6.5 



Figure 13. Autopaced sample mean values of X c data during training runs 





Figure l4. Sample mean levels of X c during the experiments 
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Figure 15. Histograms of the individual X c deviations 
from their five-trial sample means 
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c S-2 

Roll Trackin g Task (Reference 2) 
B6-l.5-£" Input 
Spring Restrained Side Stick 
O Subject GA, 2 Runs, 5 Feb. 1963 
A Subject JT, 2 Runs, 12 Feb. 1963 
0 Subject BB, 2 Runs, 31 Jan. 1963 
A Subject MS, 2 Runs, 21 Feb. 1963 
Pitch Trackin g Task (Present) 
B6-l.5-£" Input 
Force Side Stick ("Pencil") 

♦ Subject JM, 3 Runs,l8 & 23 Feb. 1965 


Figure 1 6 . Comparison of present and previous data 
describing functions for a similar task 







































Figure 19-— Concluded 
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Figure 20. Describing function data at ay. = 1. 5, X = 4.0 
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Figure 20.— Concluded 
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Figure 21 Concluded 
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X (rad/sec) 

a. Effective delay time and a 



X(rad/sec) 

b. inverse delay time 


Figure 22. Fitted a-model parameters (a, T e , and l/T e ) 
at -various levels of instability 




Upper 

Unstable 

Frequency 


Unity -Gain 

Crossover 

Frequency 


Lower 

Unstable 

Frequency 


Figure 23. Observed open- loop frequency parameters and o^) 

at various levels of instability 
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Fitted a- Model Parameters: 
O Actual Pilot Gain 
A Lower Stability Limit, Ku, 
^ Upper Stability Limit, Ku 2 



Figure 25. Observed pilot and loop gain parameters (K u -, > and Kp) 

at various levels of instability 
and comparisons with simple theoretical limits 
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Input = B6 7 - '/g 


Plain symbols: 
ujj = 1.5 rad/sec 



a. Tracking and control measures 



Figure 26. Relative rms tracking errors and control outputs 
versus the level of Instability 


'■V 1 ' ^ 

n 2 = mean -square remnant 
c 2 = mean-square control output 
Plain symbols: Wj = 1.5 rad/sec 
Tagged symbols : Wj = 4.0 rad/sec 



Figure 27. Relative coherence (p a ) as a function of X 
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APPENDIX A 


DERIVATION OF THE CRITICAL TASK LIMIT 


The effect of the low frequency kinesthetic lags, as represented by a, 
on the theoretical relation between the zero margin limit for X c and T e 
will be derived. For brevity, most of the subscripts will be dropped. 

The total open-loop describing function using the extended crossover 
model (a-model) of the human operator is given by 


^-jtoyr + a/co) 
Y P Yc = -Ts + 1 


(A-1) 


The limiting conditions for vanishing maximum phase margin are sought. 
The open-loop phase is 

cp = — n + tan 1 Ten — Ten — ~ (A-2) 

from which the phase margin is 

% = tan 1 Ten*, - Tenc - ^ (A-3) 

In the ideal limit, the critical condition occurs when both cp^ = 0 
and dep/den = 0. The expression for dep/den is 

12 = T t + -2_ = Tei^(l +aT) + a _ ( A _m 

1 + (Ten) 2 en 2 [(Ten) 2 +l] 

which is zero at the frequency for maximum phase margin , en = enpj^. Thus , 
Ten| M (l + <xT) + a = Tenp M [(Tcop M ) 2 +l] (A-5) 
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Regrouping terms. 


[(Topm) 2 + 1 ] a + Ta ^M = Tcr iM [(^m) 2 + t] (A-6) 

from which Ta| M = [(Ta)p M ) 2 + l] [to| m - a] (A-7) 

Generally, a « so 

-f = (to p M ) 2 + 1 (A-8) 

Thus, the frequency for maximum phase margin is 

<4* 4 (A - 9) 

Solving for t in the phase margin expression [eq. (A-3)J for = 0, and 
recognizing this as the limiting crossover frequency, o^, 

T ’ -3 - T-i (A-10) 


Finally, noting that in the limit = o^,, the combination of Eqs. (A-9) 
and (A-10) into a quadratic in T, plus some algebraic simplification, 
yields 

T ‘ i - V^r ; T 2 T (A -"> 

or Xo A i. _ ysr ) ; V < i (A-12) 

Normalized with respect to t, the last expression becomes 

X C T = 1 “ (A-1 3) 
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BUN LOO, AVERAGED AUTOPACED DATA, AND COMPUTER SCHEMATIC 


For the reader's reference, a run log of the pertinent runs from 
which the data of this report were extracted is given in Table B-I* All 
runs were made at the Engineering Psychology laboratory at The Franklin 
Institute under subcontract to Systems Technology, Inc. 


The critical values of k which are plotted in figures 13 and l4 are 
repeated here in tabular form (Table B-Il). The rms variance of the 
sample is given by 


°X 


V 


n 


E Ui - x ) 2 

i=1 


n 


where n is the number of trials in the sample. 


A schematic of the computer mechanization is shown in figure B-1 . 
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TABLE B-I 


CRITICAL TASK RUN LOG 


Run no. 
(a)* 

X 

(b)» 

Input 

(c)* 

Remarks 
(d, e)* 

021865-1 

4 

2 


-2 

4 

1 


-4 

X(t) 

1 


-5 

X(t) 

0 


-6 

2 

1 


-7 

4 

1 


-8 

3 

1 


-9 

5 

1 

2 min. run 

-11 

R 

S 

1 

Aborted after 45 sec 

-12 

5 

1 


-13 

3 

1 


— 1 4 

4 

1 

Data interruped after 2:05 by 




timer; 4 min. total 

-15 

2 

1 


- 16 

x(t) 

1 


021 965 - 5 

x(t) 

0 


-4 

x(t) 

1 


-5 

X(t) 

0 


-6 

4 

1 


-12 

4 

b6' -4-1/8" 


-13 

4 

00 

l 

-=)• 

1 

pa 


-18 

4 

1 


-20 

x(t) 

0 


-21 

X(t) 

1 



* a Run number is month-day-^ear— run of day; i .e. , 021865 — 1 is 
first run on Feb .18,1 965 • 

^Yc = x/(s— x); x(t) denotes autopaced run. 

C Input code: 0 = no input; 1 = B 6 ’ - 1 . 5 — 1 / 8 "; 2 = B 6 - 1 . 6 - 1 / 8 ". 

^Describing function run length is 4 min. except where noted. 

0 

Subject is J. D. McDonnell in all runs. 
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TABLE B-I.— Concluded 


CRITICAL TASK RUN LOG 


Run no. 

X 

Input 

Remarks 

022365 - 3 

x(t) 

0 


-4 

x(t) 

1 


-7 

2 

1 


-8 

4 

1 


-13 

4 

1 


— 14 

2 

1 


-16 

x(t) 

1 


022465 - 3 

x(t) 

0 


-4 

x(t) 

1 


- 5 

4 

1 

Interrupted at 3:07 

-6 

4 

2 


-7 

4 

b 6 ' -4-1/8" 

Interrupted at 2:42 and 3:47 

-9 

4 

B 6 ' -4-1/8" 


-11 

4 

1 


-12 

\(t) 

1 


-13 

x(t) 

0 


022565 -9 

x(t) 

0 


-10 

X(t) 

1 


-11 

4 

1 
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TABLE B-II 


TABUIATION OF AVERAGED AUTOPACED DATA 

Training runs (no input; 5 run samples) 


Trial no. 

Date 


a x c 

1 - 5 
10 

1 h 3/65, 2:00 PM 

5.42 

5.48 

0.37 

0.43 

15 

20 

1/13/65 , 2:35 PM 

5.76 

5.60 

0.38 

0.48 

25 

30 

1 /13/65, 5 = 15 PM 

5.82 

5.50 

0.37 

O.36 

35 

4o 

1 /l4/65, 8:30 AM 

5.92 

5.90 

0.42 

0.52 

45 

50 

1 /14/65, 11 :25 AM 

6.46 

6.60 

0.32 

0.4l 

55 

60 

l/l4/65, 5:30 PM 

6.25 

6.34 

0.21 

0.54 

65 

70 

1/25/65, 8:30 AM 

5.86 

5.9^ 

0.4i 

0.49 

75 

80 

1 /25/65, 5:10 PM 

5.84 

6.26 

0.48 

0.30 

85 

90 

I/25/65, 5:23 PM 

5-40 

6.10 

O.65 

0.49 

95 

100 

2/2 /65, 4:45 PM 

6.26 

6.30 

0.49 

0.64 

105 

110 

2/3 /6 5, 4:40 PM 

6.02 

5*66 

0.21 

0.38 

115 

120 

2/4 /65, 4:40 PM 

6.02 

5.94 

0.60 

0.39 

125 
1 30 

2/8 / 65 , 4:45 PM 

6.4o 

6.62 

0.46 

0.62 

135 
1 4o 

2/ 9 /65, 10:30 AM 

5.98 

5.90 

0.10 
1 .01 


105 


















































TABLE B-II.— Concluded 


TABULATION OF AVERAGED AUTOPACED DATA 



Training runs 

(no input) 


Trial no. 

r Date 

x c 

a Xc 

145 

150 

2/ 9 /6 5, 5:15 PM 

6.80 

6.30 

0.21 

0.55 

155 
1 60 

2/10/65, 2:30 PM 

6.04 

6.20 

0.55 
1 .21 

Data runs (from The Franklin Institute) 

No input 

Run no. 

Number of trials 


°Xc 

021 865 - 5 

6 

6.36 

0.28 

-17 

5 

6.28 

0.30 

021 965 - 3 

5 

6.27 

0.22 

-5 

5 

6.62 

0.22 

-20 

5 

6.40 

0.27 

022365 - 3 

5 

6.36 

0.26 

022465 - 3 

4 

6.51 

0.22 

-13 

5 

7.50 

0.52 

022565 - 9 

5 

6.91 

0.28 

b6' — 1.5 — 1/8" input 

Run no . 

Number of trials 

^•c 

% 

021 865 -4 

6 

5.05 

0.36 

-16 

5 

5.90 

0.45 

021 965 - 4 

5 

6.02 

0 . 4 l 

-21 

4 

6.08 

0.46 

022365 - 4 

5 

6.04 

0.26 

-16 

5 

6.22 

0.42 

022465 - 4 

4 

5-95 

0.33 

-12 

5 

6.66 

0.15 

022565 - 1 0 

5 

6.06 

0.17 































